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(54) Method and receiver for providing subtitle data in several languages on demand 



(57) Video data are transmitted to a receiver. A lan- 
guage menu is displayed from which a user selects a 
language that can be different from the original lan- 
guage broadcast with the video data. Video data identi- 
fication information and language identification informa- 
tion corresponding to the language selected from the 
menu is derived and transmitted to e.g. an Internet serv- 



er. The identification information is used to select an au- 
dio translation data set from several audio translation 
data sets stored in said server, wherein each of said sev- 
eral audio translation data sets includes a language 
translation of original audio data related to said video 
data. The selected audio translation data set is sent to 
the receiver and reproduced synchronously together 
with said video data. 




Printed by Jouve. 75001 PARIS (FR) 



1 



EP1 158 799 Al 



2 



Description 

[0001] The invention relates to the field of providing 
audio translation data on demand to a receiver. 

Background 

[0002] The number of television (TV) channels a user 
can receive has increased significantly because of the 
further development of terrestrial TV, satellite TV and 
web TV technology including digital TV transmission. In 
addition, video media, such as cassette, CD and DVD 
offer more programs or movies to the home. 

Invention 

[0003] The above developments lead also to an in- 
creased share of foreign language programs or movies. 
In an increasing number of countries or geographical re- 
gions there are multi-language requirements: there may 
be used more than one native language in one country 
or region, or non-native residents prefer to have their 
native language for home-entertainment. Therefore 
there is a growing need for broadcasting programs or 
movies with audio data or subtitles corresponding to a 
language translation preferred by the respective con- 
sumers. 

[0004] A problem to be solved by the invention is to 
provide audio or subtitle translation data on demand. 
This problem is solved by the method disclosed in claim 
1. 

A receiver that utilises this method is disclosed in claim 
9. 

A method for providing corresponding audio or subtitle 
translation data on demand to such receiver is disclosed 
in claim 11 . 

[0005] One aspect of the invention is a method for pro- 
viding audio or subtitle translation data on demand to a 
receiver, the method including the following steps: 

receiving video data; 

receiving first identification information correspond- 
ing to said video data; 

detecting a user-performed selection of a preferred 
language; 

providing second identification information corre- 
sponding to said preferred language; 
transmitting, e.g. via Internet, third identification in- 
formation derived from said first and second identi- 
fication information to a server for requesting, 
based on said third identification information, a de- 
sired audio or subtitle translation data set corre- 
sponding to said video data; 
receiving, e.g. via Internet, said selected audio or 
subtitle translation data set; 
reproducing, at least partly, data of said requested 
audio or subtitle translation data set temporally syn- 
chronised with said video data. 



[0006] According to another aspect, the invention 
concerns a receiver for providing audio or subtitle trans- 
lation data on demand, the receiver including: 

means for receiving video data and first identifica- 
tion information corresponding to said video data; 
means for detecting a user-performed selection of 
a preferred language; 

means for providing second identification informa- 
tion corresponding to said preferred language; 
means for transmitting, e.g. via Internet, third iden- 
tification information derived from said first and sec- 
ond identification information to a server for re- 
questing, based on said third identification informa- 
tion, a desired audio or subtitle translation data set 
corresponding to said video data; 
means for receiving, e.g. via Internet, said selected 
audio or subtitle translation data set; 
means for reproducing, at least partly, data of said 
requested audio or subtitle translation data set tem- 
porally synchronised with said video data. 

[0007] According to a further aspect, the invention 
concerns a method for providing audio or subtitle trans- 
lation data on demand, including the steps: 

receiving, e.g. via Internet, identification information 
requested by a user, wherein said identification in- 
formation corresponds to a preferred language and 
to video data that are originally accompanied by au- 
dio or subtitle data in a language different from said 
preferred language; 

storing or generating audio or subtitle translation 
data sets assigned to different languages for related 
video data, wherein each of said audio or subtitle 
translation data sets includes a language transla- 
tion of original language audio or subtitle data relat- 
ed to specific ones of said video data; 
selecting, upon receiving said identification infor- 
mation, an audio or subtitle translation data set, 
wherein the selected audio or subtitle translation 
data set represents a language translation of said 
original language audio or subtitle data correspond- 
ing to said preferred language, 
transmitting, e.g. via Internet, said selected audio 
or subtitle translation data set for providing it to a 
receiver of said user. 

[0008] The invention is based on the idea that differ- 
ent audio translation data sets are available in an ar- 
chive, preferably an online archive. The different audio 
translation data sets can be ordered by a user of a tel- 
evision and/or video system. This allows the user to 
have a movie or film broadcast with audio signals cor- 
responding to a language preferred him. For example, 
a visitor staying in a hotel of a foreign country can watch 
movies provided with audio signals corresponding to his 
native language. 
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The invention also allows to watch a movie, scientific 
programmes etc. in a certain foreign language or with 
subtitles in a certain foreign language in order to train 
the user's knowledge of this specific foreign language. 

Drawings 

[0009] Exemplary embodiments of the invention are 
described with reference to the accompanying draw- 
ings, which show in: 

Fig. 1 a schematical representation of a system ac- 
cording to the invention; 

Fig. 2 a simplified block diagram of an online trans- 
lation archive. 

Exemplary embodiments 

[001 0] Referring to Figure 1 , the invention can be em- 
bodied in a system including a television and/or video 
device 1 for broadcasting a movie or film, an interface 
2, and server means 3 to which several translator ac- 
counts 4 are assigned. The server means may be any 
kind of computer for operating a database storing an ar- 
chive of translation data. The server may be located at 
the broadcast station supplying the movie or film or at a 
company specialized on the supply of translation data. 
The server means may be connected with a translator 
studio 5. A user may control the television or video de- 
vice 1 and/or the interface 2 by means of a remote con- 
trol 6 and/or by voice control. The interface 2 may be 
contained in the device 1 , which device can be e.g. a 
settop-box or a TV receiver or video recorder. 
[001 1 ] If a user of the device 1 likes to watch a movie 
broadcast in any language with audio signals in a pre- 
ferred language, a language menu can be provided on 
a display 1 4 of the device 1 . By means of the language 
menu a list of several language options is presented to 
the user of device 1 , each of the several language op- 
tions representing audio translation data of a different 
language and/or from a different translator. From the 
language menu the user can select a language option 
corresponding to the language preferred by the user. 
The selection of the language option may be performed 
by means of the remote control 6 the transmitted com- 
mands of which are received by an IR receiver 1 2 con- 
tained in device 1 . 

It is also possible to select a preferred language by a 
spoken command, which is detected by a microphone. 
This microphone can be integrated in the remote control 
or in the housing of the device 1 . 
[0012] Furthermore, it is possible to select not only 
one preferred language but a most preferred language 
and a second most preferred language. In order to make 
this more clear, the following example is given. If for in- 
stance a German user stays e.g. in China and is not fa- 
miliar with the Chinese language but with e.g. the Eng- 
lish language, he may choose German as the most pre- 



ferred language and English as the second most pre- 
ferred language. In this way, the German user will get 
translation data in German language, if these are avail- 
able. If not, he will receive translation data in English 

5 language, if these are available. Only if neither German 
nor English translation data is available, he has to watch 
the movie with the original language. 
[0013] The user's selection of the language option is 
evaluated in means 1 3 for providing identification infor- 

10 mation corresponding to the preferred language and the 
video data of the movie the user intends to watch. The 
identification information is automatically passed using 
controlling means 1 1 to an output of device 1 , which out- 
put may be connected to the Internet or any othersource 

is providing data to the user's device. The identification in- 
formation may include the title of the movie or some oth- 
er identification code extracted from VPS data, teletext 
data, MPEG7 data or an EPG (Electronic Program 
Guide). 

20 [0014] The identification information is transmitted to 
a server 3, preferably through an interface 2 with online 
connection like an ISDN connection or any other Inter- 
net or cable connection. After processing the identifica- 
tion information the server 3 will supply audio translation 

25 data to the interface 2 via a back channel or via the In- 
ternet or cable. The audio translation data may be com- 
pressed, e.g. by means of MP3 or MPEG4 standard. 
The device 1 will provide video data received from a 
broadcasting station 7 in synchronization with the audio 

30 translation data received from server 3, so that the user 
can watch the movie with audio signals and/or subtitles 
corresponding to the language preferred by him. 
[0015] Also it is possible that the server sends back 
only an information about the availability of the languag- 
es es of audio signals and/or subtitles for the selected title. 
This information can be accompanied by an information 
about the cost for downloading the translation data. The 
information about the available languages can be dis- 
played by a second on-screen display, possibly together 

40 with the cost. The user then finally decides whether he 
wants downloading of the translation data. 
[0016] The controlling means 1 1 may control synchro- 
nization of the video data and the audio translation data 
by means of time stamps provided in the video data as 

45 well as the audio translation data. If the video data are 
encoded accordingto the MPEG-4 standard, resynchro- 
nization marker codes, which are inserted in the video 
data stream at certain intervals, can be used for syn- 
chronization. If the audio data are also MPEG-4 encod- 

50 ed, not the total audio signal but only the voices to be 
translated can be transmitted due to the object oriented 
transmission. This allows a very low transmission bit 
rate. 

[0017] The audio translation data provided to device 
55 1 may be intermediately stored at least partly, e.g. on a 
hard disc or other storage devices. 
[0018] In the means 13 for providing identification in- 
formation, or in the controlling means 11 , the user's lan- 
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guage selection, or selections, may be stored perma- 
nently or for a predetermined period of time so that, al- 
ways or during the predetermined period of time, audio 
translation data corresponding to the stored preferred 
language selection will be automatically delivered to the 
device 1 whenever the user wants to watch a movie, 
without it being necessary to display the language menu 
on the display 14. For example, for a period staying in 
a hotel abroad, a visitor will have the opportunity to 
watch movies in the hotel with audio translation data cor- 
responding to his native language, if a respective lan- 
guage selection made by the visitor is stored. 
[001 9] The service of providing translation data on de- 
mand may be free of charge or charged, wherein the 
user's payment can be controlled by means of the inter- 
face 2 or controlling means 11 . 

[0020] Referring to Figure 2, in the server means 3 
the audio translation data are arranged e.g. in translator 
accounts 10, 11, 12, each being related to a translator 
A. B and C, respectively, as schematically shown in Fig- 
ure 2. A translator A may have a respective account for 
German (account 10 in Figure 2), English, French (ac- 
count 1 3 in Figure 2) and/or other languages. There may 
be more than one set of audio translation data available 
in the server means 3, each set representing, for exam- 
ple, a German translation for a specific movie and gen- 
erated by a different translator, giving the user the op- 
portunity to select German audio translation data for the 
specific movie from a preferred translator. 
[0021 ] Translators may generate audio translation da- 
ta in the translator studio 5. The translator studio 5 pro- 
vides a user-friendly website interface, technical sup- 
port and translation guidance to the translators. An on- 
line connection may be established between the trans- 
lator studio 5 and the server means 4 to transmit audio 
translation data. The translator may set up a new trans- 
lator account, add new audio translation data to the ac- 
count 4 or delete previous version from the account 4. 
Audio translation data may be stored as text and/or 
voice data. In addition, the translator studio 5 may pro- 
vide online payment to the translators. 
[0022] It is possible to assign the required functions 
to different units: for instance, providing identification in- 
formation can be accomplished in interface 2 whereby 
means 13 can be omitted and IR receiver 1 2 is connect- 
ed directly to controlling means 11 . 
[0023] The audio or subtitle translation data set men- 
tioned above can be a data set including the complete 
sound track/subtitle track of one program or one movie. 
[0024] In connection with recording a program or 
movie using programming, in particular VPS or 
ShowVlew programming, it is advantageous to either 
automatically download and intermediately store the au- 
dio or subtitle translation data set in advance, or to 
download and record the audio or subtitle translation da- 
ta set during or after finishing the recording of the related 
video data and possibly original audio/subtitle data. 



Claims 

1. Method for providing audio or subtitle translation 
data on demand to a receiver (1), the method in- 

5 eluding the following steps: 

receiving (11) video data; 
receiving first identification information corre- 
sponding to said video data; 
10 _ detecting (6, 12) a user-performed selection of 
a preferred language; 

providing (13,2) second identification informa- 
tion corresponding to said preferred language; 
transmitting, e.g. via Internet, third identifica- 

*5 tion information derived from said first and sec- 

ond identification information to a server (3) for 
requesting, based on said third identification in- 
formation, a desired audio or subtitle transla- 
tion data set corresponding to said video data; 

20 - receiving (11), e.g. via Internet, said selected 
audio or subtitle translation data set; 
reproducing (1 5), at least partly, data of said re- 
quested audio or subtitle translation data set 
temporally synchronised with said video data. 

25 

2. Method according to claim 1 , further comprising the 
step of displaying (1 4) a language menu and detect- 
ing (6, 12) the user-performed selection of the pre- 
ferred language from said language menu. 

30 

3. Method according to claim 1 or 2, wherein from sev- 
eral available server-stored audio or subtitle trans- 
lation data sets one is selected, wherein each of 
said several audio or subtitle translation data sets 

35 includes a language translation of original language 
audio or subtitle data related to said video data, and 
wherein the selected audio or subtitle translation 
data set represents, corresponding to said pre- 
ferred language, a language translation of said orig- 

40 jnal language audio or subtitle data. 

4. Method according to any of claims 1 to 3, wherein 
said user-performed selection is detected, and said 
provided second identification information corre- 

45 sponding to said preferred language is stored, be- 
fore said video data are received. 

5. Method according to claim 4, wherein said video da- 
ta are recorded using programming, e.g. VPS or 

50 ShowView programming, and wherein said audio or 
subtitle translation data set is either automatically 
downloaded and intermediately stored in advance, 
or is downloaded and recorded after finishing the 
recording of the related video data and possibly 
55 original audio or subtitle data. 

6. Method according to any of claims 1 to 5, wherein 
time stamps are used for synchronizing said video 
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data with the data of said requested or selected au- 
dio or subtitle translation data set. 

7. Method according to claim 6, wherein the data are 
MPEG-4 encoded and ^synchronization marker 5 
codes are used for synchronizing. 

8. Method according to any of claims 1 to 7, wherein 
said first identification information is automatically 
provided from corresponding teletext or MPEG7 in- 10 
formation. 

9. Receiver (1 ) for providing audio or subtitle transla- 
tion data on demand, the receiver including: 

means (14) for receiving video data and first 
identification information corresponding to said 
video data; 

means (6, 12) for detecting a user- performed 
selection of a preferred language; 
means (13, 2) for providing second identifica- 
tion information corresponding to said pre- 
ferred language; 

means (11) for transmitting, e.g. via Internet, 
third identification information derived from 
said first and second identification information 
to a server (3) for requesting, based on said 
third identification information, a desired audio 
or subtitle translation data set corresponding to 
said video data; 

means (1 1 ) for receiving, e.g. via Internet, said 
selected audio or subtitle translation data set; 
means (1 5) for reproducing, at least partly, data 
of said requested audio or subtitle translation 
data set temporally synchronised with said vid- 
eo data. 

10. Receiver according to claim 9, further comprising 
means (14) for displaying a language menu, where- 
in said detecting means (6, 1 2) detect the user-per- 40 
formed selection of the preferred language from 
said language menu. 

» 

11. Method for providing audio or subtitle translation 
data on demand, including the steps: 45 



guage audio or subtitle data related to specific 
ones of said video data; 
selecting, upon receiving said identification in- 
formation, an audio or subtitle translation data 
set, wherein the selected audio or subtitle 
translation data set represents a language 
translation of said original language audio or 
subtitle data corresponding to said preferred 
language, 

transmitting (3), e.g. via Internet, said selected 
audio or subtitle translation data set for provid- 
ing it to a receiver of said user. 
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receiving (3), e.g. via Internet, identification in- 
formation requested by a user, wherein said 
identification information corresponds to a pre- 
ferred language and to video data that are orig- so 
inally accompanied by audio or subtitle data in 
a language different from said preferred lan- 
guage; 

storing or generating (A, D) audio or subtitle 
translation data sets assigned to different Ian- 55 
guages for related video data, wherein each of 
said audio or subtitle translation data sets in- 
cludes a language translation of original lan- 
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